Analytical Condition for Synchrony in a Neural Network with Two Periodic Inputs 
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In this study, we apply a mean field theory to the neural network model with two periodic inputs in order to 
clarify the conditions of synchronies. This mean field theory yields a self-consistent condition for the synchrony 
and enables us to study the effects of synaptic connections for the behavior of neural networks. Then, we have 
obtained a condition of synaptic connections for the synchrony with the cycle time T. The neurons in neural 
networks receive sensory inputs and top-down inputs from outside of the network. When the network neurons 
receive two or more inputs, their synchronization depends on the conditions of inputs. We have also analyzed 
this case using the mean field theory. As a result, we clarified the following points: (1) The stronger synaptic 
connections enhance the shorter synchrony cycle of neurons. (2) The cycle of the synchrony becomes longer 
as the cycle of external inputs becomes longer. (3) The relationships among synaptic weights, the properties of 
input trains, and the cycle of synchrony are expressed by one equation, and there are two areas for asynchrony. 
In association with the third point, the yielded equation is so simple for calculation that they can easily provide 
us feasible and infeasible conditions for synchrony. 



I. INTRODUCTION 

Neurons in neural networks interact by synaptic connec- 
tions. These complex networks, even if they consist of the 
integrated-and-fire models or the extended models, are very 
complicated to deal with directly. Up to now, many studies 
of the neural networks treat the inputs from another neuron 
as a stochastic process lfH-H3ll. Because the stochastic pro- 
cess under random noises (namely Langevin forces) is well 
studied 0], the behavior of a neuron's membrane potential 
is well analyzed using the Fokker-Planck equation IU5I1 as an 
Ornstein-Uhlenbeck process I1 1611 . Essentially, however, these 
stochastic input models approximate the network as a single 
neuron model Ill|-l8j]. Thus, it is difficult (but not impossi- 
ble B9l- ll2l0 to introduce synaptic connections appropriately 
into the distribution functions of random inputs. 

Recently, Chen and Jasnow 11711 introduced the mean field 
theory to study the synaptic plasticity. In this theory we need 
to introduce the "effective input" as a mean value of inputs to 
a population of several neurons, namely cluster neurons, from 
outside of the cluster neurons. Especially, They IU7I1 have fo- 
cused this virtue of the mean field theory on the behavior of 
neural networks driven by Poisson noises with fixed mean fre- 
quency for all neurons. And they have clarified the relation be- 
tween the mean firing frequency (or the mean firing rate) and 
the mean synaptic weight using the self-consistent condition 
obtained from the mean field theory ifTvIl . Because the mean 
field theory can reduce many synaptic connections to one con- 
nection, it enables us to analyze the effects of many synaptic 
connections in neural networks with ease. When there are a 
lot of neurons with connections and the input trains are sta- 
tionary, it is reasonable to apply the mean-field theory to this 
system] 9]. However, the mean field theory is not applicable 
when the variance of the values is so large and/or the popu- 
lation size of the variables (synaptic connections per neuron, 
for example) are so small that the mean value cannot be re- 
garded as representative. In addition, when we focus on the 
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synchronized firings, its stability cannot be discussed from the 
view point of this mean-field theory, because we do not take 
into account the transient to the steady state. This is one of the 
limitations of the method. 

Biologically, accompanied with visual perception or motor 
control, coherent oscillations have been reported in the cor- 
tices j 18142511 . The oscillations are thought to play an impor- 
tant role in the information processing in the cortices ll26l l27ll . 
For example, precise synchronization among cortical areas 
suggest visuomotor integration [28]. On the other hand, both 
feedforward and feedback anatomical projections exist in cor- 
ticocortical connections B29J. The pyramidal neurons of the 
superficial layer project to the middle layer of the higher func- 
tional region, whereas the ones of the deep layer project back 
to the superficial and deep layers Q30II . Thus cortical areas are 
reciprocally connected by feedforward (bottom-up) and feed- 
back (top-down) pathways. The bottom-up signals usually 
originate from sensory information. Consequently, some cor- 
tical regions receive both bottom-up (sensory) and top-down 
signals 13111 . 

According to the modeling study using a population of neu- 
rons that receives bottom-up and top-down periodic inputs 
with different periods 1I32I1 . the synchrony of firing often col- 
lapses. In other words, the loss of synchronized firings re- 
quires remarkably different cycles of inputs. When the differ- 
ences of the cycle times are small, the loss of synchrony does 
not occur. When the neurons receive independently fixed pe- 
riodic inputs, what determines critically if the firings synchro- 
nize or not? It is expected that the strength of synaptic connec- 
tions have great effects on synchrony because numerical stud- 
ies showed that synaptic plasticity evokes synchrony ll33l l34ll . 
Taken together, generally, synchrony depends on the synaptic 
connections as well as the periods of inputs. 

Thus the purpose of our study is to understand the effects of 
input trains such as amplitude and period, and synaptic con- 
nections on the synchrony of neural networks, using the mean 
field theory. For convenience of applying this framework, we 
regard the state in which two neurons fire with the same pe- 
riod as synchronous in this paper. Thus, although this syn- 
chrony does not require simultaneous firings, so-called syn- 
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chrony never occurs if this synchrony does not occur. Before 
we try to achieve this aim, we discuss two more fundamen- 
tal cases, that is, connected neurons without input trains and a 
single neuron receiving periodic inputs. 

In section|nJ we apply the mean field theory for the simplest 
neural network without external inputs. We assume that this 
network can be represented by a cluster consists of only two 
integrate-and-fire model neurons. This analysis clarifies that 
the stronger synaptic connections enhance the shorter cycle 
synchrony cycle of cluster neurons. In section |ni] we con- 
sider the cycle of synchrony when one periodic external input 
is provided to a neuron. The result shows that the cycle of 
the synchrony becomes longer as the cycle of external inputs 
becomes longer. In section |IV] we describe that the network 
receiving two different cycle inputs (supposed to be bottom- 
up inputs and top-down inputs) show the loss of synchronies 
in certain conditions. 



II. MEAN FIELD THEORY WITH EFFECTIVE INPUTS 

In this section, using our formulation, we discuss a periodic 
synchronized firing of neurons located in the same cortical 
region. At first, to simplify many neurons connected compli- 
catedly, we assume that two particular neurons i and j with 
a synaptic connection from j to i represent "cluster neurons". 
The membrane potentials are denoted as Vi(t) and Vj(t), re- 
spectively. The neuron j receives inputs from other neurons 
located outside the cluster. The effective value (mean value) 
of the inputs is assumed to be an "effective input" 7 e ff. This 
approximation is illustrated in Fig[T] After the firings of neu- 
ron j, the neuron i receives the output of the neuron j through 
the synaptic weight Wij. Thus, we can obtain the effective 
equations of the membrane potentials Vi (t) and Vj (t) as fol- 
lows: 



TjV J (t) = -V J (t)+I eff 



(1) 



and 



r-V^t) = -Vi(t) + J2 ™H E *(* - < 2 > 



reset potential after firing take the same value of 0. In our 
study, using the integrate-and-fire model, we assume that the 
membrane potentials reset their potential Vi (t) and Vj (t) for 
the reset potential Vq = after firings immediately. 
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Self-consistency (Eq.(7)) 



out 




where the parameters r, c, and tj denote the time-constant, 
the number of connections, and the fc-th firing time of neuron 
j, respectively. Here, we assumed that 7 e ff is constant, because 
the number of inputs from outside of the cluster is so large that 
the time average corresponds to the population average. 
From Eq. (Q}, the membrane potential Vj (t) is obtained as 



V j {t) = h s {l-e- t ' T ), 



(3) 



Then we obtain the firing time tj = kTj using the effective 
input Igff as 



Tj=-T log 



'eff ' 



(4) 



with the threshold 6. Here, for convenience of calculations, 
we use a simple condition that the resting potential and the 



FIG. 1. (Color online) We show the essential figure to clarify the 
meaning of effective inputs. In our study, inputs from outside of the 
cluster neurons i and j (whose membrane potentials are denoted as 
Vi(t) and Vj(t)) are assumed to be the effective inputs J c ff. We focus 
on the neurons i and j with J c ff- The self-consistency Eq.Q requires 
the correspondence between output signals of the neuron i (namely 
7 out ) and input signals to the neuron j (namely 7 c ff). Consequently, 
the self-consistency requires the global transition symmetry of the 
neural network. This approximation is one of the mean field theory. 



The time dependence of Vi (t) is derived from Eq. (|2) under 
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the firing of j-neuron satisfying Eq. as follows: 



Vi(t) 



Jq .7=1 k 



= w 



1 - e- f / T 



(5) 



where the parameter W — means the total synaptic 

weight. Then, we obtain the cycle-time Tj of i-neuron's fir- 
ings as 



Ti = -rlog 



1 



(6) 



Now, we consider the self-consistency 7 e g = 7 out (The mean 
output of the neuron i is denoted as 7 out in FigQ~|i; 

1 rTo c 
hff=7fT ds Y] TWij V S(s - t$) 



T 



c T /Ti Tq 

^Z w ij X! / ds5(s - kTi) 
3 = 1 fe=i Jo 



T 



(7) 



This consistency assumes that the firings of neurons are peri- 
odic and synchronized. Thus the value of I e g should indicate 
the mean value of the periodic inputs. The formula of I e g in 
Eq.© looks plausible because it corresponds to the assumed 
mean value of inputs with periodicity in the mean-field the- 
ory of previous studies Ill0l - ll2ll . We assumed the hypothetical 
cycle time Tj of the effective inputs. Then, if the periodic fir- 
ings can occur, we can find the appropriate cycle time T. But 
if there does not exist the cycle time T,-, the periodic firings 
cannot occur. This condition for the Tj is expressed in the 
self-consistency Eq.©. 

From Eqs.(@]i, ©, and @, we obtain the self-consistent 
equation as 



T 



(1 



-T/r 



W 



(8) 



where we have redefined T — Ti. The cycle-time T of spon- 
taneous firing of the cluster neurons is given as a solution of 
Eq.©. The function /(T/r) is defined as the left-side of 



Eq.©, namely /(T/r) = (r/T)(l 
/(T/r) can be expanded as 



f(T/r) = 



t/t\ -pjjg f unc tion 




(9) 



with respect to T/r. Then, the function /(T/r) has the 
asymptotic value 1 in the case of T —> (namely the fre- 
quency v = 1 /T —5- oo). Consequently, in the case of 9 > W, 



there does not exist the spontaneous firing. On the other hand, 
in the case of 8 < W, there exists the spontaneous firing. 
This result is supported by the following physical phenomena, 
that is, the firing frequency of neurons are enhanced by effec- 
tive inputs (from neighbor neurons) exceeding the threshold. 
Meanwhile the spontaneous firing does not occur under the 
weak effective inputs. 



III. SINGLE NEURON FIRING WITH A PERIODIC INPUT 
TRAIN 

In this section, we consider the case of a single neuron re- 
ceiving a periodic input train. This simple example may be 
useful to discuss the specific cases of the neural networks in- 
cluding the connections and input trains. The membrane po- 
tential Vi(t) of neuron i is characterized as follows: 



r-V i (t) = -V i (t)+I(t), 



where the input trains I(t) is denoted by 

i(t) = Ti <*(*-**); ** 

k: all past firings 



A + kT" 



(10) 



(11) 



Here the parameter T ln means the cycle time of periodic input 
trains and A means a firing phase (time lag). A is the initial 
phase in a cycle so that the next firing time shifts linearly with 
A. 

From the equations ( fTTTb and (fTTb , the time dependence 
Vi (t) is obtained as 



Vi(t) =I Q e x ' T - 



,-t/r 



,-A/t 



1 



(t < T), 



(12) 



where T denotes the firing cycle of i-neuron. Then the condi- 
tion for the firing Vi(t) =6 (9 means the threshold) gives the 
firing cycle T — Ti as 



T = A - r log 



l + f(l-e*V-) 
Jo 



(13) 



The derivative dT/dT m is derived as 



dT 

dT in ~ I Q + 9(1 - e T ' m / T ) 
1 



e (T c -T'")/r _ l 
T 



T, - T" 



(14) 



for the condition T c ~ T ln , where T c is defined as T c = 
r log(l +7q Iff) . Here the function T of T ln is defined in the re- 
gion < T ln < T c in Eq.dlJb. so that the equation ( fT4l > shows 
that the firing cycle T diverges exponentially with increase of 
T ln . From the above discussion, the firing cycle depends on 
the cycle time of input trains as a monotonically increasing 
function. 
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IV. LOSS OF SYNCHRONY WITH TWO EXTERNAL 
INPUTS 

In the previous discussions in sections [EI] and Hill the 
stronger synaptic connections yield the synchrony with 
shorter cycle while the longer cycle input train yields the 
longer cycle synchrony. Thus, one can predict catastrophes 
of synchrony if periodic spikes with longer (or shorter) pe- 
riod are input to the neurons with stronger (or weaker) synap - 
tic weights. This is the reason why the relationship between 
the synaptic connections and cycle of inputs under the con- 
dition of synchrony in the neural networks is not so simple. 
In this section, we examine the neural network receiving two 
external periodical inputs. To clarify this condition and re- 
lated phenomena analytically, we apply the mean field theory 
to the cluster neurons i and j in the network with two exter- 
nal inputs, namely Ji(t) and J^it). These two external in- 
puts Ji it) and J2 it) have the independent cycle T[ n and T™, 
respectively, and the time dependence of these inputs are ex- 
pressed as 

J,(t) = TJo5>(t-(A + fcXn), (J = 1,2). (15) 

fc 

Here Jo means the strength of inputs. In this study, we assume 
that the two external inputs have common strength. These in- 
put trains are constructed by independent Poisson processes, 
whose mean interstimulus interval is A. For the convenience 
of analysis, these input trains are averaged over the period 
from t = kT{ n (or kTf) to t = (k + l)T{ n (or (fc + l)Ti, D ). 
This averaging procedure does not lose the periodicity of in- 
put trains. 



These inputs are received by the cluster neurons i and j as 
a total external input 

J(t)=pJ 1 {t) + (l-p)J 2 (t). (16) 

The parameter p denotes the rate of the input J\{t), which 
implies the balance ratio (relative strength) of the two inputs. 
For example, in the case of p = 0.5, both two inputs Ji(i) 
and J2 it) have the same intensity of the input current. When 
p > 0.5, Ji(t) has the stronger intensity than J 2 it). 

From the above discussion, we obtain the effective equa- 
tions of motion about the cluster neurons as follows: 

r^Vj(t) = -Vj(t) + Jeff + Jit) (17) 

and 

T Jt Vl{t) = ~ Vlit) + ^ 5{t ~ ^ + J{t) - (18) 

3 tj<t 

We assumed that 7 e ff is constant because a large number of 
synaptic inputs to each neuron will cancel out the periodicity 
of input signals except the external inputs. From Eq. (fTTT i. the 
membrane potential Vj it) is obtained as 

V 3 it) = I eS (l ~ e-*/ r ) + -e-*/ T / Jis)e s,T ds (19) 
T Jo 

with using the effective input I e tf. The integration shown in 
the second term of Eq. ( TT9l > is performed as follows: 



f Jis)e s/T ds = TpJoY] f e s / T Sis-iX + kT[ n ))ds + Til-p)J o y] f e s/r 
Jo t k^Jo ,u ,Jo 



Sis - (A + k'T™))ds 



tf<t tf<t 



e (A+fc'T-)/ T 



(t-A)/r (*-A)/t 
= rp.J ]T e (W)/-+ r (l-p)J ^ 

fc=0 k=0 
.. l_ e (*-A)/r l_ e (*-A)/r 

= T P J e x > T 6 +T(l-p)J e A / T % . (20) 

Then the condition to determine the firing cycle Tj of the neuron j is obtained as 

6 = / eff (l - e T ^) - JoN(Ti n ) + (1 - P)9(T)?)}(1 - e-M-WT) (21) 



I 

with the negative function g(t) = 1/(1 — e t//r ). The time dependence of Vi(t) is derived from Eq. (fT8l l as follows: 

1 - e */r 



Vi(t) = W 



1 - e- T i/ 



- + -e- l ' T f Jis)e s ' T ds. (22) 
r Jo 



The time dependence of Vj it) yields the condition to deter- 
mine the firing cycle Tj of i -neuron as 
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9 = W \- e X ~ MP9(T?) + (l-p)g(T?)](l - e-^-^ T ). (23) 

From solving the Eq.(l2Tl with respect to Tj and inserting to Eq.d23l. when the cycle time T — Ti satisfies the self-consistent 
condition (O, namely 7 e ft = TW/Ti, the cluster neurons show the synchronized firings. The self -consistency is transcribed in 
more details as 

1 = a(l- e~ x ) 1 , J[ 1 2 ' w r -i(Tf,T 2 m )(l - e x ^- x ), (24) 



wherea = W/9,j(T?,T£) = \pg{T?) + {l-p)g(T?)]J Q /9 
and x = T/t. These parameters are normalized by 9 or r. 
The function j(T{ a , T™) takes negative value for any T[ a and 
T™, and tends to zero for as T{" or T™ tends to infinity (Figf2|i. 
The important parameters of input trains, namely the strength 
of inputs J and the input balance p as well as TJ° and TJf, 
are included in the function j (T{ n , T™). Then the behavior of 
this parameter express the property of input trains; therefore, 
we treat the parameter j(T[ a , T™) as a continuous real num- 
ber defined in the region (— oo, 0) for characterizing the input 
trains. The parameter x in Eq. (l24l corresponds to the cycle 
time of synchrony of cluster neurons. Unfortunately, one can- 
not solve the condition Eq. (l24l rigorously with respect to x. 
Then we have solved it numerically as shown in Figf3] 

As are shown in Figf3] there are two typical anomalies of 
synchronies, where the value of x cannot exist. First, in the 
region of larger a (stronger synaptic connections) and larger 



j(T{ a , T™) (longer cycle of external inputs), the shorter cycle 
synchrony enhanced by strong synaptic connections conflicts 
with the longer cycle of external inputs. We call this region 
"Region 1". Second, in the region of smaller a (weaker synap- 
tic connections) and larger j(T[ n ,T™), the cycle time of the 
synchrony increases exponentially with increasing cycle time 
of inputs. We call this region "Region 2". 

The limiting cases of Eq. (l24l clarify the "Region 1" and 
"Region 2" in Figf3] In the case of x — >• 0, Eq. ( 1241 yields the 
relation 

j(T[ n , If) = -^JT—J = M«, A, r). (25) 

On the other hand, in the case of x — > oo, Eq. (1241 yields the 
relation 



j(T m T , n) = 2 _ Ma,A,T). ( 26 ) 

2 + (a - l)e A / T + J [4a + (a - l) 2 e x / T ] e x / T 



Then, in the Region 1, parameters j^^.T™) and a satisfy 
the inequality 

j(T?,Tf)>h (a,\, T ), (27) 
while, in the Region 2, they satisfy the inequality 

j(Ti n ,r-)>/ loo (a,A,T). (28) 

Using Eqs.(l27l and (l28l . we obtain the phase diagram as 
FigH The phase boundaries are expressed by Eqs.(l25l and 
(l26l . As is shown in FigJU the synchrony occurs only in the 
outside of the Region 1 U Region 2. This simple conditional 
equation can provide us with feasibility of synchrony. From 
the derivation of Eqs.(l25l and d2ol . it is clearly understood 
that there are two types of loss of the synchrony, that is, the 
firing cycle vanishes (Region 1) and the firing cycle diverges 
(Region 2). In the intersection region of Region 1 and Region 
2, either type of the loss of synchrony can occur, which will be 
affected by the initial conditions, boundary conditions, noises, 
or others. 



V. SUMMARY AND DISCUSSION 

We have shown that the synchrony of neurons depends 
on the conditions between the cycle times of inputs and the 
amount of strength of synaptic connections, and that the syn- 
chrony collapses when they (the cycle time of inputs and the 
amount of synaptic connections) do not satisfy the condition. 
In order to obtain the conditions for synchronized firings, we 
have used the mean field theory. The solution of the self- 
consistent conditions corresponds to the cycle time of syn- 
chrony. When the conditions are constructed by indetermi- 
nate equations, such parameter regions show the loss of syn- 
chronies. As a result, there are two critical cases for syn- 
chrony: 

(1) When the synaptic connections are weaker enough and 
the cycle times of external inputs are longer enough, the 
frequency of synchronized firings becomes too small to 
observe. 

(2) The conflicts between stronger synaptic connections 
(which lead to the shorter cycle synchrony) and longer 



Region 1 




FIG. 2. (Color online) The parameter j{T? , Tf) divided by J /9 is 
shown when p = 0.8. j(T? y Tf) tends to zero as Tf or Tf tends to 
infinity. 



Region 2 



Region 1 




FIG. 3. (Color online) The firing cycle of cluster neurons: The fir- 
ing cycle x = T/t is shown in the (a,j(Tf, T™)) space. The large 
j(Tf , T™) corresponds to the long cycle input(s) as is shown in Fi^2] 
Region 1 shows that the synchrony does not occur because strong 
synaptic connections (large a) conflict with the long cycle inputs 
(large j(Tf, T^)), In Region 2, the firing cycle x diverges exponen- 
tially with increase of j(Tf, Tf). Here A/r = 1.3. 



cycle of external inputs make the loss of synchronized 
firings of the cluster neurons. 

The results mean that the synchronization in a population 
of neurons will never occur when the parameters are in the 
critical regions. From the viewpoint of information process- 
ing in the brain, this discussion suggests that a cortical region 
works when the synaptic structure matches the bottom-up and 
top-down signals. Generally, this mean field theory is appli- 
cable to many neuron models (for example, Hodgkin-Huxley 
model as is suggested by Chen and Jasnow IU7I0 . Because of 
this universality of the mean field theory, the same results may 
be obtained from other neural network models. 

In this study, we assume that a cluster of a number of 
neurons can be stochastically represented as two neurons as 




a 



FIG. 4. (Color online) Phase diagram of synchrony: The condition 
obtained in Eqs.ll27t and i2S\ is figured. The horizontal axis de- 
notes the parameter a while the vertical axis denotes the parameter 
j(r{„,T2 n ). He] . e _ 1 3 Thg Regions j and 2 correspond to 

them in Figf5] In Region 1, the firing cycle vanishes, while the firing 
cycle diverges in Region 2. 



shown in Fig[T] If we assume three or more representative 
neurons as the cluster, are the results in this study is still avail- 
able? There are two factors to affect the availability. First, 
they may depend on the structure of synaptic connections be- 
tween the neurons. When the neurons are fully connected 
each other, the results will be similar because of homogene- 
ity. However, other cases with some neurons with heteroge- 
neous connections are too complicated to be analyzed by our 
method. Secondly, when the ratio of the number of neurons to 
the number of connections is larger, the synchrony becomes 
difficult to occur under the same condition. This is because 
the fluctuations of internal states of neurons become larger. 
Consequently, our approximation is applicable when the ratio 
of the number of neurons to the number of connections is not 
so large and the connections are homogeneous. 

Finally, we would like to discuss the correspondence be- 
tween the mean field theory and Bethe approximation 113511 . 
From the view point of statistical mechanics, Bethe approxi- 
mation has been introduced to analyze magnetic materials. It 
is very difficult to analyze the magnetization because many 
spins interact each other in the magnetic materials. Bethe has 
introduced the effective theory to approximate in order to sim- 
plify the systems. In the Bethe approximation, we choose 
some spins from huge spins and call the spins a "cluster". 
Then we ignore the spins on the outside of the cluster in spite 
of introducing the effective field interacting with the boundary 
spins of the cluster. The intra-cluster interactions can be ana- 
lyzed rigorously since the cluster system is of finite size. Here 
the effective fields are determined by the self-consistency, that 
is, the bulk system corresponds to the surface system. While 
Bethe approximations are introduced in the equilibrium sys- 
tems, we or Chen and Jasnow used the mean field theory in 
the neural networks as a nonequilibrium system. However 
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this mean field theory will lead to appropriate results even in 
the time-dependent systems as far as the effective input J e ff is 
appropriate. As is also discussed in Section |U this mean field 
theory can treat the synaptic connections rigorously between 



the cluster neurons. This is the reason why it is useful to dis- 
cuss the effects of synaptic connections. Using this mean field 
theory, one may be able to clarify the other phenomena and the 
effects of synaptic connections in the neural networks. 
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